Semi-Supervised Learning via New Deep Network Inversion
نویسندگان
چکیده
We exploit a recently derived inversion scheme for arbitrary deep neural networks to develop a new semi-supervised learning framework that applies to a wide range of systems and problems. The approach outperforms current state-of-the-art methods on MNIST reaching 99.14% of test set accuracy while using 5 labeled examples per class. Experiments with one-dimensional signals highlight the generality of the method. Importantly, our approach is simple, efficient, and requires no change in the deep network architecture. 1 ar X iv :1 71 1. 04 31 3v 1 [ st at .M L ] 1 2 N ov 2 01 7
منابع مشابه
Semi-Supervised Learning Enabled by Multiscale Deep Neural Network Inversion
Deep Neural Networks (DNNs) provide state-of-the-art solutions in several difficult machine perceptual tasks. However, their performance relies on the availability of a large set of labeled training data, which limits the breadth of their applicability. Hence, there is a need for new semisupervised learning methods for DNNs that can leverage both (a small amount of) labeled and unlabeled traini...
متن کاملSemi-supervised Learning for Convolutional Neural Networks via Online Graph Construction
The recent promising achievements of deep learning rely on the large amount of labeled data. Considering the abundance of data on the web, most of them do not have labels at all. Therefore, it is important to improve generalization performance using unlabeled data on supervised tasks with few labeled instances. In this work, we revisit graph-based semi-supervised learning algorithms and propose...
متن کاملSemi-Supervised Speaker Adaptation for In-Vehicle Speech Recognition with Deep Neural Networks
In this paper, we present a new i-vector based speaker adaptation method for automatic speech recognition with deep neural networks, focusing on in-vehicle scenarios. Our proposed method is, rather than augmenting i-vectors to acoustic feature vectors to form concatenated input vectors for adapting neural network acoustic model parameters, is to perform featurespace transformation with smaller ...
متن کاملA Probabilistic Framework for Deep Learning
We develop a probabilistic framework for deep learning based on the Deep Rendering Mixture Model (DRMM), a new generative probabilistic model that explicitly capture variations in data due to latent task nuisance variables. We demonstrate that max-sum inference in the DRMM yields an algorithm that exactly reproduces the operations in deep convolutional neural networks (DCNs), providing a first ...
متن کاملDeep Learning Neural Network with Semi supervised Segmentation for Predicting Retinal and Cancer Cell Diseased
In medical field, diagnosis of diseases competently carried out by using the image processing. So that to retrieve the relevant data from the amalgamation of resulting image is too difficult. Here the segmentation done by semi supervised learning then the result is tuned by using Deep Learning Neural Network. Higher tuning of results will leads to efficient detection of disease. The experiment ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1711.04313 شماره
صفحات -
تاریخ انتشار 2017